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CENTRAL INTELLIGENCE AGENCY 
Washington, D.C. 20505 


STATOTHR 


? 6 November 1979 


P. L. Scant! ebury 

Director, Financial and General Management 
Studies Division 

United States General Accounting Office 
Washington, D.C. ? 054 P 


Dear Sir: 


Rnclosed you will find the completed questionnaire 
contained in your letter of ?3 October 1979. I hope you 
find the information useful. 

In analyzing the answers provided in the questionnaire, 
one oual i f i cation should be noted. Applications programming 
is done in this Agency on quite a decentralized basis. 

The organization which I represent within CIA is only one, 
although the largest, applications organization and represents 
only about 35-40% of the applications work done in the Agency,, 
Subsequently, while the response to questions 5, P, and 9 
represent only my group, the other responses will, in my 
opinion, roughly apply throughout the Agency. 

Should you have ar^^^m^^^^Xjuesti ons , please feel free 
to call me directly on 


STATINTL 

Teputy Duecto^o^^ncstions 
Office of Data Processing 


Enclosure : 

Survey Ouestionnai re on Applications 
Software Maintenance 
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DD/A/ODP 



2 3Nov79 


STATINTL 


Distribution: 

Original - Addressee 
1 - OLC 

1 - D/ODP 

2 - DD/A Chrono 

2 - ODP Registry 
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United States general accounting office 

WASHINGTON, D.C. 20548 



October 23, 1979 


Central Intelligence Agency 
Proc . Div. 

Washington, DC 20505 
Dear Sir : 

The U.S. General Accounting Office, an agency of the 
Congress, is currently studying Federal agencies' management of 
applications software maintenance. As part of our study we are 
interested in learning of the extent and nature of software and 
software maintenance at Federal data processing installations. 
We would also like to obtain the views of knowledgeable Federal 
data processing professionals on these subjects. 

To obtain the needed information and views, we have 
developed the enclosed questionnaire, which we would like to 
have completed by ADP managers or senior level staff at your 
installation . 

Questionnaire responses will be reported in summary form. 
Although we are requesting identifying information, we are 
doing so solely to enable us to obtain clarifying information, 
if necessary, and to supply copies of our report to those who 
request them. Also, we may visit selected installations to 
augment information on the questionnaire but our intent 
nonetheless is to present all information obtained in summary 
form . 


We would very much appreciate it if you would return the 
completed questionnaire in the enclosed envelope within 10 
days. If you have any questions, please call Mr. John Womble 
telephone number: (405) 686-2223 or FTS 732-2223, or Dr. 
Steven Merritt: (202) 275-6187 or FTS 275-6187. 


Thank you for your cooperation. 


Sincerely yours. 




t T cj 


D. L. Scantlebury 
Director, Financial 
Management Studies 



and General 
Division 


Enclosures 
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STATINTL 


U. S. GENERAL, ACCOUNTING OFFICE 
SURVEY OF 

APPLICATIONS SOFTWARE 
MAINTENANCE 


an? 

( 1 - 4 ) 


INTRODUCTION 

This questionnaire seeks information about 
Federal agencies' management of their applications 
software maintenance. The questionnaire should be 
completed at the installation level by ADP managers 
or senior staff members knowledgeable about appli- 
cations software maintenance. If the address to 
which the questionnaire has been Bent is not a data 
processing installation, please forward it to your 
organization's data processing division. 

Most questions can be answered by simply 
checking a box or writing in a small amount of in- 
formation. Where exact answers are not readily 
available, please provide the best available estimate. 
If you wish to explain or amplify any answer, please 
do so at the end of the questionnaire. 

The information we ask about the respondent is 
needed for follow-up purposes. Answers will gener- 
ally be reported in summary form. Individuals will 
not be associated with specific answers. 

Please return the questionnaire as soon as 
possible in the envelope provided. If you have any 
questions, please call Mr. John Womble on (405) 
686—2223 or FTS 732—2223, or Dr. Steven Merritt on 
(202) 275-6187 of FTS 275-6187. 

NOTE : In completing this questionnaire, 
please ignore the numbers in parentheses 
to the right of a question item; they 
are included to facilitate keypunching. 


RESPONDENT INFORMATION 



£ f a if /■& i . till. £. 1 >*<**/' * i ■ **. -■ ... 

BUREAU , OFFICE OR COMMAND ’ , 

/UtisZ/Jr/tJ, /K<‘ • 

ADDRESS ~ 7 


Part I Application s So ftware Maint enance 
DEFINITION 

For purposes of this questionnaire, we have 
def inecTapplications software maintenance as 
follows: any actions taken after implementation 
of the software to 

1) remove defects in the software including 

a) defects in which the software was 
programmed to do something other than 
what the user wanted, and 

b) defects in which the program logic was 
faulty with the result that the program 
did something other than what the 
programmer intended 

2) tune the software to make it more efficient 
(less machine time and/or less core) 

3) modify or enhance the software to make it 
perform more end-user functions, including 

fl) functions originally called for in the 
system design, but not implemented, and 

b) new functions requested by the user not 
called for in the original system design 

4) make other modifications resulting 

from miscellaneous causes such as the need 
to interface with other systems, system 
software changes, etc. 

NOTE: We are aware that each agency may 
define software maintenance differently. 
Regardless of your agency's definition, 
please answer our questions in terms ol 
all the functions included in our definitic 
above. This is necessary to ensure con- 
sistency in responses. 


1. Does your installation have responsibility for 
any applications software maintenance as defined 
above? ( 5 ) 

1. / x 7 Yes 

2. / 7 No (If no, please explain below and skip 

to question 6.) 
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Which of the following best describes the extent 
of your installation's software maintenance 
responsibilities? (Please check only one.) (6) 

1. £ ) Limited - Consists solely of identi- 

fying defects, new user requirements, 
trouble shooting, and installing 
changes for applications developed by 
a central agency function outside 
this installation 

2. £F7 Limited maintenance on centrally de- 

veloped applications, plus maintenance 
on some locally developed systems 

3. /' * ' / Full maintenance responsibility for 

all applications run at this 
installation 

4. / 7 Other (Please describe.) 


4. Please show the percentage of total software 
maintenance (as measured by staff hours) per- 
formed at your installation that falls in each 
of the following categories. Show a percent 
for each category (even if it is zero percent). 
P ercents shown should add to 100% . 


a) 


b) 


2 . 


Any actions taken after imple- 
mentation of the software to: 

Remove defects in the software, 
including 

defectB in which the software j % (8-10) 
was programmed to do something 
other than what the user 
watited 


defects in which the program 
logic was faulty with the 
result that the program did 
something other than what 
the programmer intended 

Tune the software to make it 
more efficient (less machine 
time and/or less core) 




5 


% (11-13) 


X (14-16) 


3. Is the applications software maintenance at your 
installation performed by installation employees, 
by contractor employees or by a mixture of both? 
(Please check only one.) (?) 

1. I / Installation employees do all applications 

software maintenance 

2. / / Contractor employees do all the appli- 

cations software maintenance 

3. ('*• j Applications software is maintained by 
~ a mixture of installation employees and 

contractor employees 

4. / / Other (Please describe.) 


3. Modify or enhance the software 
to make it perform more end- 
user functions, including 

a) functions originally called for / £ % (17-19) 
in the system design, but not 
implemented 

b) new functions requested by the _fjP©% (20-22) 
user not called for in the 

original system design 

4. Make other modifications % (23-25) 

resulting from miscellaneous 

causeB such as the need to 
interface with other systems, 
system software changes, etc. 


100 % Total 


5. Please estimate the percentages of the following 
resources' times that are devoted to the soft- 
ware maintenance functions listed in question 
4. Please show a percentage for each item even 
if it is zero. 


Personnel 



Programmer /analyst 


(26-28) 

Operations personnel 

0 % 

(29-31) 

Administrative personnel 

0 % 

(32-34) 

Management personnel 

V* 

(35-37) 

Hardware 



CPU time 

3> % 

(38-40) 
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6. Are the applications programs in use at your 
installation primarily business applications, 
primarily scientific applications, or a mix-,, 
ture of both business and scientific applica- 
tions? (Please check only one.) (41) 


1. £ 7 Primarily business applications 

2. / 7 Primarily scientific applications 

3. !'\/J A mixture of business and scientific 
^ applications 


4. £ 7 Other (Please describe.) 


7. Do most of the application programs in use at 

your installation run in production for a year or 
more before being discarded or replaced; do most 
run for leas than a year; is the number running for 
a year of more about equal to the number that run 
for less than a year? (Please ’check only one.) (42) 


1 . 

2 . 


Jgg.. Most run for a year or move 
/ ~7 Most, run for less than a year 


3. / / About as many last a year or more as 

last less than a year 


8. Next we are. interested in the programming languages used in your installation. Please state for each of 
the languages listed below the number of application programs in that language currently in use in your 
installation and the average production life in years at your installation of the application programs 
in that language. 

No. of programs Average length of production 

whose source code life of programs in the 

LANGUAGE is in the language language in years 


COBOL / / l/ld/O/ (43-47) „ / / ffi/ (48-49) 


FORTRAN 


/,57 0/ o/ 

(50-54) 


/ 

± 

a 

(55-56) • 

PL/I 

{&,Q,Ql <5) 

(57-60) 


. ... . . 7 / 

•L 

(61-62) 

BASIC 

/ 

! rfl&l 

(63-66) 


/ 

/ 

h 

(67-68) 

ALGOL 

/ 

/ 1 JL l 

(69-72) 


/ 

1 

/ (73-74) 

ASSEMBLY* 

/ 

I'ikO f 

(5-8) 


:■ l/lPl 

1(80) 

Dupl (1-4) 

(9-10) . 

GMS-l/CMS-2 

/ 

till 

(11-14) 


/ 

/ 

/ 

(15-16) 

PASCAL 

/ 

IIII 

(17-20) 


/ 

1 

/ 

(21-22) 

RPG 

/ 

/ / /Si 

(23-26) 


■ / 

iSi 

(27-28) 

LISP 

/ 

iiii 

(29-32) 


/ 

I 

/ 

(33-34) 

SIMSCRIPT 

/ 

III! 

(35-38) 


/ 

/ 

/ 

(39-40) 

GPSS 

/ 

/Ill 

(41-44) 


/ 

± 

/ 

(45-46) 

DYNAMO 

/ 

IIII 

(47-50) 


, ) 

/ 

(51-52) 

SNOBOL 

/ 

IIII 

(53-56) 


/ 

/ 


(57-58) 

SCORE 

/ 

IIII 

(59-62) 


/ 

/ 

/ 

(63-64) 

EASY-TRIEVE 

. / 

IIII 

(65-68) 


/ , 

■± 

/ (69-70) 

DYL-260 

/ 

IIII 

(71-74) 


• ‘ , 

1 

/ 

(75-76) 

DATA BASE LANGUAGES 

/ 

/%! $/ £)/ 

(5-8) 


/ 

I 

it 

2(80) 

Dupl (1-4) 

(8-10) 

OTHER (Specify) 

/ 

IIII 

(11-14) 


■ ■ / 

± 


(15-16) 


* Assembly Languages include BAL, EASYCODER, AUTOCODER, GMAP, COMPASS, etc. 
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y, Please write in the age (i.e., how long it has been in production) of the 
in uae at your inetellation. Write in your estimat e. 


appl ication program 


ii. 


years (17-18) 


0. In what language ie the oldest application program in use at your installation written? (Please check 
only one.) , ( 19 ) 

x * LJ cobol 2 - £ZJ Assembly language* 3. / 7 FORTRAN 5. I~~J Other (Please specify.) 


* ASSEMBLY LANGUAGES INCLUDE BAL, EASYCODER, AUTOCODER, GMAP, COMPASS, etc. 

Which, if any, of the following software tools and techniques are in use at your installation? (Please 
check all that apply.) 


Tool 


1 • / ><7 Automated documentation (20) 

2. HI Source text manipulation (21) 

/ \Jf' Program optimisation (22) 

Aida built into compilera (23) 


3. 

A. 

3. 


£37 Special programming languages 
compilers 

(ZJ 


(24) 


6. ££7 Preprocessors (25) 

7. CO Progrem performance evaluation (26) 

8. LJ Design language (27) 


Techniqu e 

1. £3^ Code arrangement (28) 

2. CJ Descriptive documentation (29) 

3. CJ Performance documentation (30) 

A. /jy^Embedded documentation (31) 

5. £37 Programming practices standards (32) 

6. £g y R. -■use of slready written coda (33) 

7. / / Quality assurance organisation/ 

management ( 34 ) 

8. / y/ '^Daeign (35) 


9. /~~7 Programming organization/management (36) 

. Doaa your installation have an on-going ( regular basis ) effort to do optimization on application programs 
to reduce the machine coats of running them? (Please check only one.) (37) 

1- C3 Ye. 2. Cl No 3 .JO Not sure 

. Are cost accounting procedures in effect at your installation to capture personnel, hardware, and over- 
head cost associated with application software maintenance as defined in this questionnaire? (Please 
check only one.) (■jgj 

i-Ci Yes 2. / / No 3. C~ 7 Not sure 

, If yes, are report* showing these costs regularly produced? (Please check only one.) (39) 

X " lOj Yea 2. / / No 3. £0 Not applicable - no procedures 

Please attach a sample sheet from such a report showing cost elements reported, if one is 
available. 

ct III Opinions and Vie ws 

’. Based upon your experience, do you believe that application software developed by contractors requires 
more or less maintenance than application software developed in-house? (Please check only one.) (40) 

L 7 Contractor-developed software require* more maintenance 

2 ■ CO Contractor-developed software requires about the same amount of maintenance 

3. f 7 Contractor-developed software requires less maintenance 

o 

4. £T7 No opinion 
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In your opinion, which, if any, of the follow- 
ing actions would result in the greatest reduc- 
tion in the size of the government's applications 
software maintenance effort? (Please check only 
, ( 41 ; 

one . ; 

1 f / Better definition of user require- 

ments in the system development stage 

2. / 7 Better definition of user require- 

— ments for modifications to existing 
sof txjare 

3, / 7 Use of software tools and techniques 

" in system development (structured 

design, structured coding, etc.) 

4 > j 7 Providing better tools and techniques 
for maintenance programmers (such as 
interactive terminals, text editors, 
and program analysis tools, etc.) 

5. / 7 Mote thorough testing of applications 

programs before the system is re- 
leased to production 

6. / 7 Eliminating unnecessary changes re- 

quested by users 

7 b j 1 7 Nothing-such a reduction is not 
~ possible 


8. AvPZ Other (Please specify.) 

r _ 


19. If you have any additional comments on any 
of the questions in the questionnaire or on 
any other aspect of software maintenance, 
please provide them in the space below. If 
you would prefer to convey your views separately, 

please write: 

Mr . John Womble 

U. S. General Accounting Office 
200 N. W. 5th, Room 348 
Oklahoma City, Oklahoma 73102 


Dr. Steven Merritt 

U. S. General Accounting Office 

441 G Street, N.W. 

Washington, D. C. 20548 

Attn: FGMSD , Room 6011 

or call them. Their telephone numbers are 
listed on page 1 of the questionnaire. Thank 
you for your cooperation. 




17. Does the definition of software maintenance used 
in this questionnaire generally agree with your 
agency's definition? 

1. /"I/^Yea 

2 . / 7 No 

3 . / / Not sure 

18. If not, briefly state your agency's definition. 


3 ( 80 ) 


5 
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United states general accounting oftice 

WASHINGTON, D.C. 20548 

/ 

STATINTL 

October 23, 1979 

Central Intelligence Agency 
Proc. Div. 

Washington, DC 20505 
Dear Sir s 

The U.S. General Accounting Office, an agency of the 
Congress, is currently studying Federal agencies' management of 
applications software maintenance. As part of our study we are 
interested in learning of the extent and nature of software and 
software maintenance at Federal data processing installations. 
We would also like to obtain the views of knowledgeable Federal 
data processing professionals on these subjects. 

To obtain the needed information and views, we have 
developed the enclosed questionnaire, which we would like to 
have completed by ADP managers or senior level staff at your 
installation . 

Questionnaire responses will be reported in summary form. 
Although we are requesting identifying information, we are 
doing so solely to enable us to obtain clarifying information, 
if necessary, and to supply copies of our report to those who 
request them. Also, we may visit selected installations to 
augment information on the questionnaire but our intent 
nonetheless is to present all information obtained in summary 
form . 

We would very much appreciate it if you would return the 
completed questionnaire in the enclosed envelope within 10 
days. If you have any questions, please call Mr. John Womble 
telephone number: (405) 686-2223 or FTS 732-2223, or Dr. 

Steven Merritt: (202) 275-6187 or FTS 275-6187. 

Thank you for your cooperation. 




HcJ Z/W 



Sincerely yours, 


D. L. Scantlebury 



Director, Financial and General 


Management Studies Division 


Enclosures 


,h6n 


i 

! 

! 

i 
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TRANSMITTAL SLIP 

DATE 

TO: D/ODP - '//* 8 

ROOM NO. 

2D00 

BUILDING 

Hdqs . 


REMARKS: 


&C-C ^ /f/±) 


FROM: 


DD/A/ODP 



FORM NO ,r\A \ REPLACES FORM 36-8 

I FEB 55 irr I which may be used. 


STATINTL 


Approved For Release 2001/08/07 : CIA-RDP84-00933R000400020003-5 




